In this era, people using vehicles is getting increased day by day. As pedestrians leading a dog for a walk, or hurrying to their workplace in the morning, we've all experienced unsafe, fast-moving vehicles operated by inattentive drivers that nearly mow us down. Many of us live in apartment complexes or housing neighborhoods where ignorant drivers disregard safety and zoom by, going way too fast. To plan, monitor and also control these vehicles is becoming a big challenge. In the article, we have come up with a solution to the above problem using the video surveillance considering the video data from the traffic cameras. Using computer vision and deep learning technology we will be able to recognize violations of rules. This article will describe modern CV and DL methods to recognize vehicle on the road and traffic violations of rules by them. Implementation of methods can be done using OpenCV Python as a tool. Our proposed solution can recognize vehicles, track their speed and help in counting the objects precisely.